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Introduction 

Intermittent  rather  than  continuous  service  is  characteristic  of 
service  systems  in  which  servers  must  be  absent  periodically  for  other 
duties  or  for  rejuvenation.  Intermittent  service  is  also  used  in  systems 
where  short  queues  are  tolerable,  or  where  short  busy  periods  for  servers 
are  uneconomical.  In  designing  such  systems,  a  natural  question  is:  How 
long  should  the  server  be  absent  without  observing  the  queue  and  at  what 
queue  length  should  the  server  start  serving  customers? 

In  this  paper,  we  address  this  question  for  an  M/G/l  queue  that 
operates  under  a  (T,N)-policy  as  follows.  Customers  arrive  by  a  Poisson 
process  {A(t);  t  >0}  with  rate  A,  and  the  service  times  have  a  mean 
p  *  and  a  finite  variance,  and  p  >  A.  For  simplicity,  we  assume  the 
system  begins  at  time  zero  with  the  server  deactivated  and  no  customers 
in  the  queue.  The  server  remains  idle  in  the  time  interval  10,T]  and,  at 
time  T,  the  queue  is  inspected  which  reveals  A(T)  customers  waiting.  If 
A(T)  is  less  than  a  number  N,  then  the  queue  is  inspected  continuously 
until  the  time  of  the  N-th  arrival.  Thereupon  the  server  is  activated 
for  service  and  serves  customers  continuously  until  the  system  becomes 
empty,  at  which  time  the  server  is  deactivated.  On  the  other  hand,  if  at 
time  T  it  is  found  that  A(T)  >  N,  then  the  server  is  immediately 
activated  for  service  and  serves  customers  until  the  system  becomes 
empty,  as  in  the  previous  case.  This  idle-inspection-service  cycle  is 
repeated  indefinitely. 

Associated  with  this  (T.N)-policy  are  costs  for  inspecting  the 
queue,  for  activating  and  running  the  server,  and  for  holding  customers 
in  the  system.  The  aim  is  to  find  the  design  parameters  (T,N)  that 
minimize  the  average  cost  of  operating  the  system. 
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We  begin  our  analysis  in  Section  1  by  deriving  an  expression  for  the 
average  cost  of  a  (T,N)-policy.  Then  in  Section  2  we  present  a  method 
for  computing  an  optimal  (T,N)-policy .  We  also  give  some  insights  into 
how  the  optimal  policy  changes  as  the  parameters  of  the  model  change. 

The  special  (T,N)-policy  with  T=0  (no  idle  time)  is  the  well-known 
N-policy  studied  by  Yadin  and  Naor  (1963),  Heyman  (1968),  and  Sobel 
(1969);  related  works  are  Bell  (1971),  Balachandran  (1973),  Levy  and 
Yechiali  (1975),  Tijms  (1976),  Talman  (1979),  Shanthikumar  (1981),  Kimura 
(1982),  and  Lu  and  Serfozo  (1984).  Also,  the  special  (T,N)-policy  with 
N=1  (no  inspection  period)  is  essentially  the  T-policy  studied  in  Heyman 
(1977)  (Heyman  and  Sobel  (1982)  discuss  the  N-  and  T-policy  as  well).  In 
Herman's  model,  when  the  server  completes  an  idle  period  and  finds  no 
customers  waiting,  then  the  server  takes  another  idle  period;  in  our 
model  the  server  is  committed  to  serve  after  each  idle  period.  We  show 
how  our  analysis  can  be  easily  modified  to  conform  to  the  former 
assumption.  In  addition  to  finding  an  optimal  (T,N)-pollcy,  our  model  is 
useful  for  comparing  the  costs  of  various  (T,N)-policies  in  which  one 
parameter  is  fixed  and  the  other  one  is  optimized. 


1 .  The  Average  Cost  of  a  (T,N)-Policy 

In  this  section,  we  derive  an  expression  for  the  average  cost  of 
operating  the  M/C/ l  queue  under  a  fixed  (T,N)-pol icy .  We  begin  by 
introducing  more  notation. 

Associated  with  the  idlo-inspection-service  cycle  described  above, 
we  let  i  denote  the  length  of  time  that  the  queue  is  inspected  after  time 
T,  while  no  services  are  being  performed.  Namely,  i  =  max{0,  -  T}. 

At  time  T  +  i  the  server  begins  a  busy  period.  The  number  of  customers 
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waiting  at  the  start  of  this  busy  period  is  v  =  max{A(T),N}.  We  let  B^ 
denote  the  length  of  the  busy  period  starting  with  v  customers.  Then  the 
total  duration  of  the  idle-inspection-service  cycle  is  S  =  T  +  i  +  B^. 

We  assume  that  the  costs  of  operating  the  system  are  as  follows: 

K  =  cost  per  cycle  for  activating  and  deactivating  the  server 

v  =  cost  per  unit  time  of  inspecting  (viewing)  the  queue 

r  =  cost  per  unit  time  of  running  the  server 

h  =  cost  per  unit  time  of  holding  one  customer  in  the  system. 

Then  the  total  cost  for  a  cycle  is 

Z  =  K  +  vi  +  rB^  +  h Jq  X(t)dt, 

where  (X(t);  t  >  0 }  is  the  number  of  customers  in  the  system  over  time. 
The  integral  is  the  total  customer  waiting  time. 

Our  main  concern  is  the  average  cost  per  unit  time  over  the  infinite 
horizon,  which  we  denote  by  C(T,N).  Since  the  traffic  intensity  p  =  A/p 
is  below  one,  the  queueing  process  is  regenerative,  and  so  it  is  well 
known  that  C(T,N)  =  EZ/ES. 

An  expression  for  this  cost  is  given  in  the  following  result.  For 
this,  we  let  t  denote  the  length  of  a  busy  period  for  a  standard  M/G/l 
queue  started  with  one  customer,  and  let  W  denote  the  total  waiting  time 
of  the  customers  present  in  this  busy  period.  It  is  known  (e.g.  see 
p.  447  in  Heyman  and  Sobel  (1982)),  that 


(1.1)  Ex  =  l/(p  -  A) 

(1.2)  EW  =  Ao2/ (2(1  -  p)2)  +  l/(p  -  A), 
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where  a  is  the  variance  of  the  service  time.  We  also  let 


N-l 
=  Z 


(N  -  n)( AT)ne“AT/n! 


*,(T,N) 
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<j>„(T,N)  =  Z  (N2  -  n2)(  AT)ne-XX/n. 
n=0 

Theorem.  Under  the  preceding  assumptions, 

(1.3)  ES  =  [T+A"14»1(T,N)]/(l-p) 

(1.4)  EZ  =  K  +  [h(  AT) 2  +  h^2(T,N)  +  4>1(T,N)(2v(  1-p)  -  h)  ]  /  [ 2  A(  1-p)  ] 

(1.5)  C(T,N)  =  (h/2)  {[aAK  +  (AT)2  +  (av-1)  <J>^(T,N) 

+  4»2(T,N)  ]/[  AT  +  ^(T.N)]}  +  rp  +  hA(l-p)EW, 

where  a  =  2(l-p)/h. 

Proof.  By  the  definition  of  the  cycle  time  S,  we  have 

(1.6)  ES  =  T  +  Ei  +  EB^. 
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Clearly 

(1.7)  Ei  =  E[E(max{0,  SN  -  T}|A(T))] 

N— 1 

=  £  E(SN_n)P(A(T)=n)  =  ^(T.Nj/A. 

n=0  1 

, t2 , . . .  are  independent  copies  of  t 
that  are  independent  of  v.  Then  by  a  standard  conditioning  argument  and 
(1.1),  we  have 

(1.8)  EBy  =  EvEt  =  Ev/(p  -  A), 
where 

(1.9)  Ev  =  E[A(T)  +  max  (0 ,  N  -  A(T)  }] 

=  AT  +  ^(T,N). 

Combining  (1.6)  -  (1.9)  yields  expression  (1.3). 

Now  consider  the  expected  cycle  cost 

(1.10)  EZ  =  K  +  vEi  +  rEBy  +  hE  J2  X(t)dt. 

We  already  have  expressions  for  Ei  and  EB^.  It  remains  to  find  an 
expression  for  the  expectation  of  the  waiting  time 


Next,  we  can  write  B  =LV  ,  x,  ,  where  x, 

v  k=1  k’  ] 
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(1.11)  Jq  X(t)dt  =  /J  A(t)dt  +  /^+lA(L)dt  +  fy+ ^X( t)dt , 


By  Fubini's  theorem,  we  have 


(1.12) 


E  /J  A(t)dt  =  /J  EA( t)dt  =  /J  Xtdt  =  AT2/2. 


Next,  observe  that 

T+1  N-l 

(1.13)  E  L  A(t)dt  =  E[I(A(T)  <  N)  Z  nY  ] 

n-A(T)  n 

_  N-l 

-  X  E[I(A(T)  <  N)  Z  n]  , 
n=A(T) 

where  Y^,  Y2»...  are  independent  exponential  variables  with  mean  X  *  that 
are  independent  of  A(T),  and  1  is  the  indicator  function.  Then  applying 
the  identity 

N~i  ,  , 

l  n  =  [ ( N- 1 ) N  -  m(m+l) ]/2  =  [(N^-ni  )  -  ( N-m) ]/2 

n=m 

to  (1.13),  and  recalling  the  definitions  of  <f>j  and  ^ »  we  obtain 

(1.14)  E  jJ*  A(t)dt  =  [^(T,N)  -  4>1(T,N)]/(2X). 

Finally,  we  can  write 

v  t 

J*+t  X(t)dt  =  Z  /t  V"n  X(t)dt, 
n=l  v-n+1 

where  t  =  inf  (t  >  T  +  i:  X(t)  =  n  }.  In  the  time  interval  [t  , ,  , 
n  v-n+1 

t v_n ] *  the  process  X(t)  starts  at  v-n+1  and  remains  above  this  level 
until  the  end  when  it  reaches  v-n.  Let  (t^,W^),  (t2,W2),...  denote 
independent  copies  of  ( t,W)  that  are  independent  of  v.  Then 


v-n+1 


X(t)dt  =  W  +  (v-n)t  , 
n  n 


where  W  is  the  area  under  X(t)  above  the  level  v-n,  and  (v-n)t  is  the 
n  n 

area  under  X(t)  below  v-n  (t  =  T  +  i  +  x,  +. . .+  t  ) .  It  follows  that 

v-n  I  n 
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(1.15) 


E  J“  X(t)dt  =  E  £  W .  +  E{E[  Z  (v-k)T.  |  v] } 
k=l  k=l 


where 


(1.16) 


=  EuEW  +  EtE[  Z  (  v-k)  ] 
k=  1 

=  EvEW  +  EtE(v2-v)/2, 


Ev2  =  E[A(T)2  +  max  {0,N2-A(T)2}] 


=  AT  +  (AT)  +  4>2(T,N). 

Substituting  (1.11)  -  (1.16)  into  (1.10)  yields  expression  (1.4). 
expression  (1.5)  follows  from  (1.3),  (1.4)  and  C(T,N)  =  EZ/ES. 


2 .  Computation  of  Optimal  (T,N)-Policies 

In  this  section,  we  address  the  problem  of  finding  a  (T.N)-policy 
that  minimizes  the  average  cost  C(T,N). 

As  a  first  step,  consider  the  subproblem  of  minimizing  C(T,N)  over  N 
for  T  fixed.  This  is  of  interest  in  itself  when  one  is  designing  a 
system  in  which  the  idle  time  T  is  preset  and  cannot  be  varied.  The 
solution  to  this  subproblem  is  as  follows. 

Theorem  2.1.  For  each  T,  the  cost  C(T,N)  has  a  unique  minimum  over  N, 
which  is  attained  at  the  value 


(2.1) 


N(T)  =  min  {N >1 :  D(T,N)  >  0}, 


where 


(2.2) 


D(T,N)  =  AT(av-l)  -  a\K  -  (AT)  + 


(2N+1)[  AT  +  4>1(T,N)  ]  -  $2(T,N). 


Proof.  It  is  easily  seen  that 


(2.3) 


^(T.N+l)  =  ^(T.N)  +  F(N) 
$2(T,N+1)  =  4>2(T,N)  +  (2N+1)F(N), 


where  F  is  the  Poisson  distribution  with  mean  XT.  Using  these 
expressions  and  (1.3)  -  (1.5),  one  can  show  that 

C(T,N+1)  -  C(T,N)  =  D(T,N)(h/2)F(N)/[(AT  +  ^  (  T,N) ) ( AT  +  ^ ( T ,N+1 ) ) ] . 
The  terms  following  D(T,N)  are  positive,  and  so  C(T,N)  will  have  a  unique 
minimum  over  N  at  the  value  (2.1)  if  D(T,N)  is  strictly  increasing  in  N. 
But  this  is  true  since  one  can  show  that 

(2.4)  D(T,N+1)  -  D(T,N)  =  2[  AT  +  ^(T.N)]  >  0. 

Computation  of  Optimal  N(T)  Policies.  The  optimum  N(T)  in  (2.1)  can  be 
obtained  by  computing  D(T,N)  recursively  by  the  following  formulas  based 
on  (2.3)  and  (2.4): 

(2.5)  ♦j(T.N)  *  ^(T.N-l)  +  F(N-l) 

D(T,N)  =  D(T , N- 1 )  +  2( AT  +  $  ( T , N- 1 ) ) ,  N  >  2 
where  4>^(T,1)  =  e  *T. 

Our  computations  show  that  N(T),  as  a  function  of  T,  is 

nonincreasing  and  then  nondecreasing.  This  was  as  anticipated:  For  T 

near  zero,  N(T)  is  moderate  since  it  is  the  major  control  parameter;  as  T 

grows,  N(T)  can  be  reduced,  but  it  eventually  tends  to  <». 

Remark .  Recall  that  the  (T,N)-policy  with  T=0  is  the  N-policy.  In  this 

case,  4>j(0,N)  =  N,  ^(O.N)  =  and  D(0,N)  =  +  N  -  aAK;  and  so  the 

1/2 

optimal  N(0)  is  the  smallest  integer  greater  than  (1/4+aAK)  -  1/2. 

This  is  consistent  with  Heyman  (1968). 

Now  consider  the  problem  of  finding  an  optimal  (T,N)-policy.  This 
problem  can  be  expressed,  with  Theorem  2.1  in  mind,  as 

(2.6)  min  C(T,N)  =  min  min  C(T,N)  =  min  C(T,N(T)). 

T,N  T  N  T 

If  the  function  C(T)  =  C(T,N(T))  were  to  have  a  unique  minimum,  say  at 
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T* ,  then  it  would  follow  from  (2.6)  that  (T*,N(T*))  is  the  unique  optima 
(T,N)-policy.  Because  the  function  (T)  is  rather  intractable,  we  were 
not  able  to  prove  that  it  has  a  unique  minimum.  However,  extensive 
computations  showed  that  (T)  does  indeed  have  a  unique  minimum;  we 
enumerated  hundreds  of  functions  and  each  one  had  a  unique  minimum. 
Computation  of  Optimal  ( T , N)-Policies .  From  the  preceding  comments,  it 
follows  that  an  optimal  (T.N)-policy  can  be  computed  as  follows. 

Consider  a  grid  of  T-values  T  ,  T^,...  as  fine  as  desired.  Using 

(2.1)  and  (2.5),  compute  N(T)  and  C(T)  =  C(T,N(T))  for  the  successive 

* 

T-values  T^.T^,...  until  the  time  T  =  min{T^:  C(T^)  <  C(T^+^)}. 

The  resulting  (T*,N(T*))  is  the  optimal  (T,N)-policy.  (Alternatively, 
one  may  find  the  T*  that  minimizes  C(T)  over  T  in  {T^ ,T^ , . • .  }  by  a 
Fibonacci  or  Golden  Section  Search  Procedure,  where  N(T)  and  C(T)  are 
computed  at  each  stage  by  (2.1)  and  (2.5).  However,  the  saving  of 
computation  time  by  this  approach  is  negligible.) 

This  procedure  is  very  easy  to  implement.  Examples  of  optimal 
(T,N)-policies  computed  by  it  are  shown  in  Table  1.  For  these 
computations,  we  set  A  =  1  (which  is  equivalent  to  A  being  the  time 
unit),  and  we  set  a  =  2(l-p)/h  =  1  (which  is  equivalent  to  a  '  being  the 
monetary  unit). 

The  average  cost  associated  with  an  optimal  (T,N)-policy  is 
C(T*,N(T*))  =  hC*/2  +  rp  +  hA(l-p)EW, 
where  C*  denotes  the  expression  in  braces  in  (1.5),  which  is  the  only 
term  relevant  to  the  optimization  (the  other  terms  do  not  depend  on 
(T,N)).  Some  of  the  values  of  C*  associated  with  Table  1,  for  v=30,  are 


as  follows: 
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K=100 

200 

300 

400 

500 

C*=20 

28 

35 

40 

45 

These  C*  values  are  rounded  Co  the  nearest  integer.  The  corresponding 

values  of  C*  for  v  below  30  are  not  more  than  one  unit  below  these  values 

for  v=30.  The  C*  is  obviously  increasing  in  v  and  K.  Note  that  the 

optimal  policies  do  not  depend  on  the  cost  r  of  running  the  server  or  on 
2 

the  variance  a  of  the  service  time. 

Remark.  If  there  is  no  cost  for  inspecting  the  queue  (v=0),  then  it  is 

optimal  to  continually  inspect  the  queue  and  have  no  idle  time  (T*=0). 

3  C  (  T  W 

This  intuitively  obvious  result  follows  since  one  can  show  that  - -  = 

0  when  T=0. 

It  is  of  interest  to  know  whether  the  optimal  policy  (T*,  N(T*))  is 
nonincreasing  or  nondecreasing  in  a  particular  input  parameter.  For 
example.  Table  l  shows  that  T*  I  in  v,  but  N(T*)  V  in  v.  Here  is  a 
formal  result  in  this  regard. 

Theorem  2.2. 

(i)  T*  is  strictly  +  in  each  of  the  parameters  K,  v  and  p. 

(ii)  N(T*)  t  in  K  and  +  in  v. 

(iii)  N( T* )  t  in  p  for  p  <  iifl  =  inf  {p:  T*  >  v/X2K},  and  N( T* )  +  in  p  for 

P  >  V 

Proof .  These  properties  are  based  on  the  following  result.  Consider  an 

optimization  problem,  like  ours,  of  the  form 

min  f ( x  ,  v ) , 
xeS 

where  S  is  a  subset  of  the  line  or  plane  and  v  >  0  is  a  parameter  of 

★ 

interest.  Suppose  f(x,v)  has  a  minimum  over  x  e  S  at  the  point  x  (v); 

when  there  are  several  minima  we  assume  there  is  a  smallest  one  and  call 


it  x  (v).  That  is,  we  assume  the  following  minimum  exists 


x  (v)  =  min{x:  f(x,v)  =  min  f(x',v)}. 

x' 

* 

It  is  known  (see  for  instance  [8])  that  x  (v)  t  or  1  in  v  according  to 


3f  *  3f 

whether  —  (x,v)  I  or  t  in  x;  moreover  x  (v)  is  strictly  monotone  when  — 
3v  3v 


(x,v)  is. 

First  consider  T*  and  N(T*)  as  functions  of  y.  One  can  show  that 


3~  3T3~yN)  =  "  vA3p  2tF(N_I)  +  ^(T,N)(1  -  F(N-l))] 
/[  XT  +  4>1(T,N)  ]  2  <  0. 


Thus,  it  follows  by  the  preceding  comments  that  T*  is  strictly  t  in  p 
(as  asserted  in  (i)).  Similarly, 


3C(T,N+1) 

3u 


3C(  T ,  N) 
3p 


Xy  2f(n)(ktx2  -  v) 


/[XT  +  <}>1  (  T ,  N+ 1 )  ]  [  XT  +  <J>1(T,N)]  . 


This  expression  is  negative  or  positive  according  to  whether  T  is  <  or  > 
v,/KX“.  Th '  s  observation  and  T*  being  strictly  increasing  in  p  proves 
assertion  (iii).  Assertion  (ii)  and  the  rest  of  (i)  follow  by  similar 
argument  s . 

Remarks .  Our  model  assumes  that  after  each  idle  period,  even  when  there 
are  no  customers  waiting,  the  server  is  committed  to  an 
inspection-service  period.  A  variation  is  that  when  a  server  completes 
an  idle  period  and  finds  no  customers  waiting,  then  it  takes  another  idle 
period.  The  results  above  also  apply  to  this  setting:  just  replace 
^(T.N)  and  <j>2  ( T ,  N )  by  -^(T.N)  -  Ne“ AT  and  ^(T.N)  -  N2e_AT, 
respectively.  Note  that  the  (0,N)-policy  in  this  setting  is  not  the 
N-policy,  whereas  in  our  model  it  is. 
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Table  1 

OPTIMAL  ( T ,N)~ POLICIES 
The  Table  entries  are  T*  N(T*). 


10.0  1 

11.0  1 

11.8  1 


18.4  8 

19.0  8 


